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TITLE: INTERACTIVE MEDIA RESPONSE PROCESSING SYSTEM 



FIELD OF INVENTION 



The present invention resides in the field of interactive media, and more 
particularly relates to an apparatus and method for processing responses 
5 received from set top boxes and related devices in interactive media networks. 



BACKGROUND OF THE INVENTION 



10 Interactive media refers to interactive content that may originate from 

multiple heterogeneous interactive networks and associated access devices 
including Interactive Television (iTV), Interactive Internet PCs and networked 
appliances, and Interactive mobile and wireless hand-held devices. Interactive 
media systems generally allow a content provider to broadcast information to a 

15 user and the user to respond and thereby participate in the broadcast. The 
specific types of access devices include but are not limited to a television, 
personal computer, cellular telephone, pager, or various hand-held electronic 
devices such as those manufactured by PALM. 

A basic form of interactive broadcasting includes information which is 

20 distributed on one media and invites a response through other media. An 
example of this type of interactivity is telephony, where a television program 
invites viewers to participate in a telephone poll. Viewers participate by dialing 
a particular number corresponding to the viewer's selection from among a 
number of choices. Other interactive television programs invite user 

25 participation by voting on a web site over the Internet. For example, news 
analysis programs frequently include online polls conducted simultaneously 
with a news broadcast. The user can log onto the news program web site and 
make a selection, and the poll results are displayed on the television screen. 
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There are also interactive programs that implement both of these programming 
techniques. 

Interactive Television refers to applications in which viewers interact in 
some way with the broadcast content. Interactive TV encompasses a range of 
5 interactivity types. At the most basic level, viewers can interact with their 
televisions simply by using a digital set- top box (STB). With no signal sent 
outside of the home, the STB can store information and customize the display 
based on viewer preferences. Examples of this type of interactivity are 
scrollable /customizable electronic programming guides and personal recording 

10 services. At a higher level of sophistication, viewers can send requests to a 
server via dial-up, digital back channel, or satellite transmission. The server 
sends request replies back to the STB from which the response requests 
originated. Examples of this type of interactivity are polling applications where 
viewers can "play along" with game shows, or applications tied to commerce in 

1 5 which viewers can respond to ads with requests for information or by making a 
purchase. However, existing iTV systems suffer from a lack of sufficient 
bandwidth to support real-time interactive processing desirable with this type of 
interactivity. Further, existing systems are not capable of processing the high 
volume of responses which may be received for a given application. 

20 In prior art iTV systems, there is generally a central communications 

server, also known as a head-end, which distributes television content to 
individual subscribers through set-top boxes and receives interactive 
information in the form of responses. These systems are often incapable of 
handling a high volume of responses in real time. Consequently there have 

25 been a number of systems patented that attempt in some fashion to overcome 
this capacity limitation. 

One of these patents, U.S. Patent 5,857,190, discloses an event logging 
system for use in an iTV network. An event evaluator residing with the user 
determines whether an event is loggable or non-loggable. The loggable events 

30 are preferably batched together and sent to a head end. 

In U.S. Patent 6,067,107, an iTV system is disclosed in which user 
responses are stored in broadcast receivers, assigned priority values based on 
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the type of data contained therein, and periodically transmitted to a local data 
center. Typically the responses are transmitted at 24-hour intervals. The local 
data center stores the responses in a response database, and then the 
responses are cross-referenced with subscriber information and sent to a 
5 master data center. 

Both of these systems do not have the ability to either handle large 
volumes of requests in real time or provide real-time feedback to content 
providers. Further, the information is stored in various databases in a 
hierarchical or relational manner, which limits the capacity of each database. 

10 Relational database designs typically introduce increased latencies, reliability, 
and availability problems when employed in interactive media systems. These 
databases require substantial maintenance, especially when attempting to scale 
with multiple distributed databases. Relational databases which are employed 
in relational database-centric transaction processing architectures suffer from 

15 the following deficiencies: limited real-time processing, limited volume and 
cost-prohibitive scaling capability, distributed database synchronization, 
database corruption and continuing maintenance, interrupted transaction 
recovery reprocessing and unavailability of originating transaction requests, 
limited audit trail granularity capability, and lack of practical real-time data 

20 access for decision reporting and analysis. 

SUMMARY OF THE INVENTION 

25 The present invention is directed to an interactive media response 

processing system and method which processes subscriber responses using 
non-relational database structures. Such a system and method also are 
capable of processing a high volume of responses in real time, and also have the 
capability of providing real time feedback to a content provider. In a more 

30 particular aspect of the present invention, a distributed structure is employed, 
whereby the primary components are separated in physical space so that each 
performs a specified task and then forwards responses through the system. 
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In an interactive media system according to the present invention, 
interactive content is distributed or broadcasted to a subscriber using any of a 
plurality of techniques, mechanisms or systems known to those skilled in the 
art such as through interactive cable television, interactive satellite television, 
5 interactive PC and networked appliances, and interactive mobile and cellular 
telephone networks. The interactive content is broadcast to subscribers via 
access devices including set top boxes or other devices known to those skilled 
in the art for connecting with the response processing system, used in 
conjunction with remote controls, keyboards, televisions, interactive radios, 

10 networked computers and appliances, mobile and cellular telephones, voice 
recognition devices, and/ or wireless handheld devices such as those 
manufactured by PALM and clones thereof. 

Response requests are sent by a subscriber connected to a subscriber 
network via one of the above access devices in response to the interactive 

15 content viewed on a television screen or other display. Response requests can 
be associated with the following event class types, including: interactive polling 
or voting, interactive sweepstakes, interactive advertising, interactive "game 
shows", electronic commerce, betting and wagering, and requests for additional 
information in response to a show or advertisement. It is within the scope of 

20 the present invention for the subscriber network to comprise in part the 

techniques, mechanisms, or systems used for distributing or broadcasting the 
interactive content as well as other and different types of subscriber networks, 
(e.g., telephony). 

Event applications typically have a common question and answer format, 
25 but many different actions can be taken by the application according to the 

information gathered. In addition to questions and answers (responses), game 
events may also use clues, which can be associated with the questions. Event 
applications execute based on a predetermined set of interactive rules, and are 
capable of processing and logging subscriber-input responses. Event 
30 applications also can differ in how they process information for aggregation 

purposes, and how they determine what types of responses are to be sent back 
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to either the data stream head (for broadcast to all access devices) or to each 
individual viewer (response replies) . 

The interactive media response processing system of the present 
invention includes a response collection and aggregation network performing 
5 collection and aggregation functions in real time, using non-relational database 
structures. In a more particular aspect, the collection and aggregation network 
performs the foregoing functions using a distributed processing mechanism. 
An event development kit and a content development kit facilitate content 
authoring and interpretation of subscriber responses by the response collection 

10 and aggregation network. The event development kit configures event 

applications in an appropriate format so that the responses can be read and 
interpreted by the response collection and aggregation network. The content 
development kit is available from third party vendors and is known to those 
skilled in the art as a tool for converting conventional content into interactive 

15 content. Interactive content is broadcast to subscribers via set top boxes or 
other access devices. The interactive content also can include a trigger 
transmitted with an application to be sent back with a subscriber response 
request for the purpose of identifying the response request. The subscriber 
responses are forwarded through the response collection and aggregation 

20 network. Aggregated results can be accessed by content producers via a 

producer browser associated with each of the content producers. Similarly, 
content developers have access to aggregated response information through 
developer computers. Thus, the content producers and content developers can 
access aggregated result information (aggregated data) in real time, while an 

25 event is running. The aggregated data can be stored on a web server for 

producer and developer use and also transmitted to a database server to be 
forwarded to a data warehouse. 

The stored results can be logged, stored, and archived in the data 
warehouse, for auditing and reporting purposes. The data warehouse stores 

30 information for the purpose of statistics analysis and reporting to interested 

parties. Aggregated results information can be referenced as a way to conduct 
post-event surveys and market research, while maintaining appropriate privacy 
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and security standards. For example, responses to an interactive shopping 
program can be analyzed to determine what types of items are most popular, 
and the program can be modified accordingly. Such modifications can be 
effected while the event is running or for an event to be run subsequently. 
5 Sensitive subscriber information can be encrypted and stored in a secure data 
store section to ensure safe handling. 

The interactive media response network of the present invention has the 
capability of being adjusted or adapted so as to be used in conjunction with one 
or more cable television subscriber networks, satellite television subscriber 

10 networks, mobile subscriber networks, and/or networked PCs and computer 
appliances subscriber networks known to those skilled in the art. Each of the 
subscriber networks includes a distribution network for broadcasting 
interactive content to subscribers via set top boxes or other access devices. 
These one or more networks also can be used to receive response requests from 

15 subscribers which are transmitted to one or more communications message 
servers connected to the networks. Each communications message server 
normalizes the interface from the subscriber network and forwards response 
batches to one or more response collectors, where responses can be collected, 
processed, and logged. Response collectors transmit the collected responses to 

20 one or more aggregators, each of the aggregators performing a real-time data 
collection, processing, logging, and aggregation function. In a further 
embodiment, a master aggregator is provided to aggregate information from the 
one or more aggregators to provide a master information store and coordinate 
the scheduling of all interactive event applications. In an exemplary 

25 embodiment, response collectors are located with local distribution networks 

and communications message servers, and the aggregators are located in a data 
center that can be remote from the response collectors. In another 
embodiment, the collectors are located in the central data center in closer 
physical proximity to the aggregators. 

30 The present invention is configured so as to be capable of handling 

responses being transmitted in any of a number of different formats known to 
those skilled in the art, including but not limited to the following: HTTP, HTTPS 
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(SSL), TCP and UDP over IP, FTP, HTML, XML, Enterprise Java, and Internet 
browser technology. The response aggregators, response collectors, 
communications message servers, and other components operate independently 
of set-top boxes or other access devices and are designed to be server-side 
5 platform independent. 

Other aspects and embodiments of the invention are discussed below. 



BRIEF DESCRIPTION OF THE DRAWINGS 

10 

For a fuller understanding of the nature of the present invention, 
reference is made to the following detailed description taken in conjunction with 
the accompanying drawing figures wherein like reference characters denote 
corresponding parts throughout the several views and wherein: 
15 FIG. 1A is a schematic view of an interactive media system with a 

response collection and aggregation network of the present invention; 

FIG. IB is a schematic view of the interactive media system of FIG. 1A 
showing a more detailed view of a distribution network as connected to access 
devices and the return path from the access devices; 
20 FIG. 2 A is a schematic view of an exemplary interaction between a 

response collector and response aggregator of the present invention; 

FIG. 2B is a schematic view of an exemplary interaction between a 
communications message server and response collector of the present 
invention; 

25 FIG. 3 is a schematic view of an exemplary arrangement of collectors to 

an aggregator and a master aggregator; 

FIG. 4 is a flow diagram depicting the flow of data in a preferred 
embodiment of the present invention; 

FIG. 5 is a flow diagram depicting the typical messaging protocols 
30 employed in the flow diagram of FIG. 4; 
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FIG. 6 is a schematic view of an interactive media response network 
heterogeneous access model, according to one preferred embodiment of the 
present invention; 

FIG. 7 is a schematic view of an interactive television response network 
model for multiple interactive television networks, according to another 
preferred embodiment of the present invention; and 

FIG. 8 is a schematic view of an interactive television response network 
distributed aggregator and collector model, according to a further preferred 
embodiment of the present invention. 



DETAILED DESCRIPTION OF THE INVENTION 
INCLUDING THE PREFERRED EMBODIMENT(S) 

15 An interactive media response processing platform is disclosed including 

a system and method for processing subscriber responses associated with an 
interactive activity, preferably in real time. Using the distributed network 
approach of the present invention, real-time interactivity between the broadcast 
program and the active subscribers is facilitated, because by virtue of the non- 
20 relational distributed database structure of the network, there is sufficient 
capacity to support high volume processing and real-time interactivity. 

In the interactive media response processing system, interactive content 
may originate from interactive access networks and associated devices 
including cable, satellite, and terrestrial television networks; Internet networks; 
25 mobile and wireless networks; and other types of networks which support 

interactivity or using any other techniques, methods, mechanisms, or systems 
known to those skilled in the art. Access devices include but are not limited to 
interactive Set Top Boxes (STBs) or other devices known to those skilled in the 
art that are connectable with the response processing system and used in 
30 conjunction with remote controls, keyboards, televisions, interactive radios, 

networked computers and appliances, mobile phones, voice recognition devices, 
and/ or wireless hand-held devices. 
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Response requests are sent by a user connected to a subscriber network 
via one of the above access devices which is capable of receiving an interactive 
media broadcast and transmitting signals through the subscriber network. 
Response requests may be associated with interactive events including game 
5 shows, polling or voting, sweepstakes, advertisements, sporting events, 
wagering applications, and shopping purchases via electronic commerce. 
Advertisements and sporting events are examples of complex interactive events, 
which may incorporate other interactive event types to provide further 
interactivity within the active interactive context. The interactive response 

10 processing system can support very high levels of interactivity where audience 
response is integrated into a broadcast in real time, for such applications as 
audience polling and real-time auctions. It also is within the scope of the 
present invention for one type of subscriber network to be used to broadcast or 
distribute interactive content and another type of subscriber network to be used 

15 to transmit the subscriber's response requests. 

The interactive response processing system according to one aspect of 
the present invention performs interactive response request collection and 
aggregation functions utilizing distributed processing systems. FIG. 1A 
illustrates an interactive media system 10 for supporting the broadcast of an 

20 interactive media event or program (e.g. a polling event or an application for 
supporting shopping/ electronic commerce). The interactive media system 10 
includes a response collection and aggregation network 12, which maintains 
individual subscriber and combined aggregated results from one or more 
network(s) of subscribers in persistent storage and provides real-time feedback 

25 to content producers based on these results. The collection and aggregation 
network 12 is compliant with established and emerging interactive media 
industry standards and associated technologies including, but not limited to, 
Advanced Television Enhancement Forum (ATVEF), ATVEF Advanced Television 
Forum (which also uses the ATVEF standard), and Digital Video Broadcast 

30 Multimedia Home Platform (DVB-MHP). 

As shown in FIG. 1A ? components of the interactive media system 10 
include an event development kit 14 and a content development kit 16. The 
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event development kit 14 and content development kit 16 represent content 
authoring tools which enable content developers to interface their interactive 
content in an appropriate format so that responses can be read and interpreted 
by the response collection and aggregation network 12. Alternatively, the 
5 interactive system can operate without the event development kit or the content 
development kit if interactive content is otherwise interfaced so that response 
requests are readable by the response collection and aggregation network 12. It 
should be recognized that the content development kit 16 is well known to 
those skilled in the art and is a commercially available tool for converting 

10 conventional content into interactive content. The event development kit 
configures event applications in an appropriate format so that subscriber 
responses can be read and interpreted by the response collection and 
aggregation network 12. 

As shown in FIG. IB, the event development kit 14 produces an event 

15 interface file 15 which is combinable with the content development kit 16 to 
conform interactive content to an appropriate readable format. For cable and 
satellite television, the event interface file 15 preferably conforms to ATVEF or 
DVB-MHP standards. The interactive content also can be transmitted with set 
top box event triggers. These triggers are a mechanism for identifying a 

20 response request received in the response collection and aggregation network 
12. The event development kit 14 communicates event parameters and rules 
being employed in a given interactive application back to a web server 33 in the 
response collection and aggregation network 12, so that the network can 
accurately process and log responses received. For example, the event 

25 development kit 14 can generate an event configuration file 13 to reside on the 
network pathway (as seen in FIG. IB). Alternately, the event parameters and 
rules can reside in event configuration files resident in each response collector 
and response aggregator, as discussed with reference to FIG. 2A. 

The content development kit 16 includes any of a number of 

30 commercially available tools for authoring interactive content (i.e. content which 
can be inserted into a television or other media broadcast and which invites 
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user responses). A suitable content development kit is sold under the trade 
name OpenTV OpenAuthor. 

The content authoring and production section 18 is configured and 
arranged to generate broadcast signals having interactive content interspersed 
5 therein. In the illustrated content production section 18, conventional video 20 
is manipulated using interactive video production tools 22 , such as those 
manufactured by Chyron Corporation, which prepare the video to receive 
interactive content. A producer event browser 19 is operably connected to the 
video production tools 22, so that relevant information provided by the 

10 producer can be incorporated into an interactive broadcast. The producer event 
browser 19 is operably connected to the web server 33 in the response 
collection and aggregation network 12. Accordingly, response information is 
transmitted from the web server 33 to the producer event browser 19 so that it 
can be incorporated into an event broadcast. 

15 This content is transmitted by the video production tools 22 to the 

content development kit 16 and to an interactive content and video content 
synchronizer 24, which synchronizes interactive content and video to produce a 
combined signal of conventional and interactive media content. This combined 
signal is aggregated with the software code from the content development kit 16 

20 as interfaced with the event development kit 14. Conventional content 
aggregators 26 perform the aforementioned aggregation function, so the 
resulting signal is suitable for transmission to subscribers over one or more 
distribution networks 28. This resultant signal transmits interactive content in 
the appropriate software compliant format so that responses received from 

25 subscriber set top boxes are capable of being read, interpreted, and logged by 
the response collection and aggregation network 12. It should be recognized 
that the foregoing is illustrative of an exemplary content production section 18, 
and that it is within the knowledge or skill of anyone skilled in the art to arrive 
at other configurations and arrangements of functionalities otherwise 

30 consistent with the purpose and function of the content production section 
herein described. 
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The signals sent to an access device 30 over one of the distribution 
networks 28 preferably include set top box event triggers which serve as 
identifiers and are transmitted with response requests to the response 
collection and aggregation network 12 for a given interactive event. As shown 
5 in FIG. 1A, each subscriber is connected to the distribution network 28 via an 
access device 30 such as a set top box or other interactive access device. It will 
be apparent to those of ordinary skill in the art that the access device 30, as 
shown in FIG. 1, is representative of various devices known in the art that are 
capable of receiving and transmitting interactive content over a network. In 

10 particular embodiments, the access device 30 comprises a set top box, a 
personal computer, a cellular phone, or other electronic device. 

The access device 30 is capable of storing and processing a plurality of 
interactive event applications 31a received from content producers, wherein 
each of the applications can be associated with one or more corresponding 

15 event triggers 31b. When a subscriber responds to a broadcast application by 
making an interactive response request through the access device 30 ? the 
appropriate event trigger 31b is saddled with the response and transmitted 
back through the distribution network or other type of network provided for 
receiving and transmitting such responses. The distribution networks 28 are 

20 capable of multiple path content transmission, so that upon receiving response 
requests from one or more access devices 30 , the response requests can then be 
forwarded to one or more communications message servers 29 of the response 
collection and aggregation network 12. 

In certain embodiments, e.g. when the distribution network 28 is a 

25 satellite distribution network, response replies can either be transmitted back 
through the distribution network 28 or sent to the one or more communication 
message servers 29 by an alternative path, as seen in FIG. 1A. The 
communications message servers 29 normalize the interface between the one or 
more distribution networks and the response collectors and response 

30 aggregators to enable an efficient data flow through the response collection and 
aggregation network. As seen in FIG. IB, in a preferred method of data 
transmission, response requests from access devices 30 are transmitted to 
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communications message servers 29 in HTTP format. The communications 
message servers 29 convert the response requests from HTTP format to UDP 
format to enable more efficient data transmission to the response collectors 32 
and the response aggregators 34. 
5 The response collection and aggregation network 12 includes one or more 

response collectors 32 performing a response collection function, each response 
collector receiving response requests from the one or more communications 
message servers 29. Response collectors 32 exchange information with one or 
more response aggregators 34 which perform both collection and aggregation 

10 functions. Response aggregators 34 generally collect and aggregate response 
information from the one or more collectors 32 and transmit the aggregated 
information back to the content production section 18 via an application server 
36 and the web server 33 to provide real-time feedback to content producers. 
The application server 36 is also connected to a database server 37 which 

15 receives event information for transmission to a data warehouse 38 for logging 
and storage. Preferably, transfer of aggregated information to the data 
warehouse 38 occurs after an event has run, in order to preserve system 
capacity. 

The response collection and aggregation network 12 is capable of 
20 providing secure, reliable, and redundant super high volume response 

collection and processing within each of the deployed head-end infrastructures 
(through the subscriber/ distribution networks) of the interactive media system 
10. The response collectors 32 are each configured and arranged so as to be 
capable of processing in excess of 100,000 responses or transactions per 
25 second. This is several orders of magnitude better than conventional relational 
database-centric transaction-based architectures that typically are capable of 
processing about 200 or less responses or transactions per second. The 
response collectors 32 of the present invention are capable of handling events 
with a transmission rate of fewer than 100,000 responses/ transactions per 
30 second as well. For example, an event having a transmission rate of 1,000 
responses per second can be handled simultaneously and along the same 
pathway as another event having a transmission rate of 75,000 responses per 
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second. A further event with a transmission rate of 200 responses per second 
can be handled along the same pathway. The responses or transactions are 
processed in the collection and aggregation network of a single system, i.e. a 
single closed-loop information flow path. In specific embodiments, responses 
5 and transactions are logged and stored redundantly to achieve a system 
reliability of about 99%, more particularly about 99.99999%. 

The collection and aggregation network 12 processes the responses in 
real time, without the need to assign priority values to responses received. 
Each collector is capable of hosting a multiplicity of events, as demonstrated 

10 above, reducing the number of components required to process responses. 
Thus, the interactive media system 10 is capable of supporting events which 
have limited appeal and very few simultaneous responses, and events having 
wide appeal and several millions of simultaneous interactive responses. 

The response collection and aggregation network 12 performs interactive 

15 response request collection and aggregation functions utilizing non-relational 
database structures (e.g., flat file databases) and distributed processing 
mechanisms. Specifically, the present invention teaches a logically distributed 
architecture design capable of providing super high-volume real-time 
transaction request collection, processing, aggregation, and results aggregation 

20 reporting. The architecture's logical separation of these components supports 
partially distributed and fully distributed processing scenarios. 

The primary components of the response collection and aggregation 
network include one or more response aggregators, response collectors, and 
communications message servers (see FIGS. 2B and 4-8). In the partially or 

25 fully distributed model of the present invention, one or more of these primary 
components can be deployed physically separate from the other components. 

FIG. 2A illustrates a detailed view of a typical response collector 66 
(identical to the response collectors 32 in FIGS. 1A and IB) and a typical 
response aggregator 52 (identical to the response aggregators 34 in FIGS. 1A 

30 and IB) of the present invention. The response collector 66 includes a plurality 
of sub-components which enable it to perform collection functions. The 
response collector 66 includes a communications handler 66a which processes 
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incoming traffic (i.e. normalized responses which are in UDP or other standard 
format) from a communications message server 64 (see FIG. 2B ? wherein the 
communications message server 64 is identical to the communications message 
servers 29 in FIGS. 1A and IB) and routes messages to and from appropriate 
5 interactive event products 66b. Each of the event products 66b corresponds to 
an interactive event application, a portion of an event, or a collection of 
individual events. Each event product 66b collects, processes, and stores 
information related to its respective event and provides instructions to other 
components of the collector 66. Response replies, if desired in a given event 

10 application, are generated by the products 66b and transmitted back through 
one or more subscriber networks (e.g. distribution networks 28 shown in FIG. 
1A) via the communications handler 66a. 

The response collector 66 includes a scheduler 66d which defines when 
and how an event is to be hosted on the response collection and aggregation 

15 network 12. For example, the scheduler 66d determines what time of day a 
particular event application will be broadcast over a subscriber network and 
communicates with an aggregator-based scheduler 52d and other collectors so 
that the appropriate products 66b/ 52b are configured to process responses. 
The scheduler 66d records and distributes pertinent event information to a 

20 gateway messenger 66c linked directly to the products 66b, and the gateway 

messenger 66c also serves as the connection between the response collector 66 
and the response aggregator 52, whereby collector event results are transmitted 
to the aggregator for further processing and aggregation, and published event 
information is sent from the aggregator to the collector to enable collector 

25 scheduling and hosting of events. 

The collector 66 can further include an event configuration file 66g 
generated by the event development kit 14 and transmitted to aggregators 52 
and collectors 66 for communicating the appropriate parameters and rules for a 
given event. The products 66b can access the event configuration file when 

30 necessary to obtain additional scheduling information for an event. 

The response collector 66 also further includes an Interactive Response 
Management System (IRMS) 66e which logs transactions/responses as directed 
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by the event products 66b. The event products 66b determine whether a 
response should be logged. When the IRMS 66e logs a response, it appends a 
log record to the Master Journal File (MJF) 66f corresponding to the response. 
The MJF is a data file which stores logged response information for 
5 transmission to the response aggregator 52 via the gateway messenger 66c, and 
which can be transmitted to the data warehouse (described below) for retrieval 
and analysis. 

The event products 66b transmit collected response information to the 
gateway messenger 66c for the purpose of forwarding the information to the 

10 response aggregator 52. The response information generally includes summary 
data in a form which can be processed in an aggregator which handles response 
information from one or more collectors. A gateway messenger 52c in the 
response aggregator 52 receives the collected response information and routes 
it to the appropriate products 52b in the aggregator 52. Products 66b and 52b 

15 are non-relational database structures with extremely high response capacity 
such that the responses and response information can be processed in high 
volume and in real time. 

The response aggregator 52 is constructed in a manner similar to the 
response collector 66. Collected response information received in the products 

20 52b is aggregated in the appropriate product of the aggregator 52. Each 

aggregator 52 includes an IRMS 52e which appends a MJF 52f as described 
above. Further, to obtain event rules and parameters, the products 52b can 
access an event configuration file 52g generated by the event development kit 
14. 

25 A gateway messenger 52c provides two-way interaction between the 

aggregator and an application server 54 (as described below with reference to 
FIG. 4, wherein the application server 54 is identical to the application server 
36 in FIGS. 1A and 1B) ? and can also be used to provide connectivity to external 
systems for further processing of interactive responses. The gateway messenger 

30 52c communicates real time event data to a producer web site and receives 
published event information (i.e. rules and parameters of an event) from the 
producer web site via the application server. The published event information 
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is incorporated into the event configuration files 52g and 66g in the aggregators 
and collectors, respectively. Published event information can be sent back 
through the gateway messenger 52c to the response collector. Because 
responses are transferred through the collector and aggregator in real time, the 
5 response information reaches the content producers in real time. This allows 
content producers to make real time modifications to the interactive content 
being broadcasted to subscribers to tailor the content to the responses received 
from subscribers and in accordance with particular response patterns. 
The functionalities corresponding to the above-described sub- 

10 components are in the form of software applications executable on one or more 
computing or processing systems. In an exemplary, illustrative embodiment, a 
response collector 66 or response aggregator 52 according to the present 
invention includes any of a number of multi-processor computing systems 
known to those skilled in the art, including for example an SMP system and 

15 software application programs for executing thereon, configured and arranged 
so as to be capable of performing the above-described functions of the response 
collector and aggregator sub-components. 

FIG. 2B shows the interaction between the response collector 66 and a 
communications message server 64. The communications message server 64 

20 normalizes the interface from one or more subscriber networks and its 

associated access devices (e.g. set top boxes) to the response collector 66 and 
the response aggregator 52. By normalizing response transmission, i.e. 
transmitting responses in a data format readable by a collector 66 and/ or an 
aggregator 52, an efficient data flow can be maintained through the interactive 

25 media response network. 

The communications message server 64 includes a communications 
handler 64a connected to a device communications handler for set top boxes 
(STB) 64c and a device communications handler for mobile phone/ WAP 
communications 64d. The communications handler 64a controls how incoming 

30 response requests are processed in the communications message server and is 
responsible for maintaining interactive response processing sessions between 
the collectors and access devices, thereby managing the creating, persistence, 
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and destruction of the sessions (e.g. HTTP sessions) associated with subscriber 
access devices. The set top box communications handler 64c receives response 
requests from set top boxes via cable ? satellite, or terrestrial subscriber 
networks and, if required, delivers corresponding response replies. The mobile 
5 phone communications handler 64d receives response requests from mobile 
phones via mobile phone access networks and, if required, delivers 
corresponding response replies. The communications handler 64a controls the 
flow of response traffic to and from the communications handlers 64c and 64d. 
Device message parsers /formatters 64b receive response requests from 

10 the communications handlers 64c and 64d and normalize the response 

requests such that the response collector 66 receives the requests in a standard 
format. The message parsers /formatters 64b include message parsers which 
process incoming response requests and strip off all unnecessary information, 
and message formatters which format the parsed response requests to create 

15 messages in the desired format. For example, as discussed herein, response 
requests transmitted from set top boxes in cable or satellite subscriber 
networks are generally in HTTP or HTTPS (HTTP with SSL security) format. The 
message parsers/ formatters 64b receive the response requests from the set top 
box communications handler 64c and convert the response requests to 

20 Universal Datagram Packet (UDP) format. Similarly, the message 

parsers /formatters 64b convert response requests transmitted by mobile 
subscriber networks from WAP format to UDP format. 

The message parsers/ formatters 64b exchange information with their 
respective device communications handlers 64c and 64d, so that response 

25 requests are routed in UDP format to the communications handler 64a, which 
transmits the response requests to the communications handler 66a in a 
response collector 66. The collector communications handler 64a receives 
response replies from the collector 66 and delivers the response replies to the 
appropriate communications handler 64c, 64d for transmission back through a 

30 subscriber/ distribution network. Although the device communications 

handlers 64c and 64d as shown are intended for use with set top boxes and 
mobile telephones, respectively, other types of devices can be supported in the 
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communications message server 64, including but not limited to 
communications handlers adapted to receive signals from Internet appliances 
and personal electronic devices. 

The communications handler 64a further provides the capability of 
5 bundling and unbundling messages. Packetizing (bundling) of response 

requests and de-packetizing (unbundling) of response replies provides increased 
communications efficiencies in the communications message server, in order to 
effectively process different volumes of messaging traffic, including extremely 
high volumes of messages. Thus, the communications message server 64 is 

10 capable of sustaining high message traffic spikes and bursts resulting from 
large scale simultaneous event participation by many subscribers. 

The communications message server 64 preferably operates in one of two 
ways. The communications message server 64 interfaces with a subscriber 
network directly via the network operator's infrastructure server platform (as 

15 depicted in FIGS. 2B and 6). In an alternate response path, the 

communications message server 64 can interface with a subscriber network 
indirectly via the network operator's connectivity infrastructure (not shown) , 
bypassing the network operator's infrastructure server platform. 

The functionalities corresponding to the above- described components of 

20 the communications message server 64 are in the form of one or more software 
applications executable on one or more computing or processing systems. In 
an exemplary, illustrative embodiment, the communications message server 64 
includes a computing system having one or more processors and one or more 
software applications programs for executing thereon, configured and arranged 

25 so as to be capable of performing the above-described functions of the 
communications message server sub-components. 

FIG. 3 illustrates the relationship of one or more collectors 66 to one or 
more aggregators 52. The collectors and aggregators can be configured and 
arranged so as to form any one of a number of relational arrangements, 

30 including but not limited to one-to-one, a plurality or multiplicity of collectors to 
an aggregator, and a plurality of collectors to a plurality of aggregators. In 
certain embodiments of the present invention having more than one aggregator 
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in the network, the collection and aggregation network can include a master 
aggregator 51, constructed in a manner similar to aggregators 52, which 
aggregates the results from each individual aggregator 52 and provides real 
time event feedback to content producers and developers through an 
5 application server 54 (discussed below). As seen in FIG. 3, response collectors 
66 are operably connected to a subordinate aggregator 52, which is operably 
connected to a master aggregator 5 1 via the respective gateway messenger sub- 
components. 

FIGS. 4 and 5 depict typical data flow and communications standards, 
10 respectively, employed in the interactive media response network of FIG. 6 (and 
also applicable to FIGS. 7 and 8). As seen in FIG. 4, a subscriber can view 
interactive content through an access device 60 and issue response requests to 
be handled by the communications message server 64. The communications 
message server 64 normalizes the responses and transmits responses or 
15 response batches to the response collector 66. The response collector 66 

receives the responses/response batches, and then separates, processes, and 
logs the responses. This information is then collected and aggregated in the 
response aggregator 52. The response aggregator 52 provides response 
information to the application server 54, which can transmit information to a 
20 web server 55 to provide real time feedback to content producers and content 

developers. The application server 54 is also connected to a database server 57 
which transfers aggregated response information to a data warehouse 59 for 
storage. 

The application server 54 is operably connected to the web server 55, 
25 which provides real-time response information to event producers accessible 
through a producer event browser 58, so that such information can be 
integrated into interactive broadcasts. Developers can access the web server 55 
using their personal computers 56, in order to publish event information so 
that network aggregators and collectors can handle the responses associated 
30 with events. In addition to event information, the content developers (also 

known as content providers) can provide additional interactive content which is 
to be inserted directly into an event broadcast. Such information can be 
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provided to complement changes inserted by content producers. A network and 
event management workstation 94 coordinates each event in accordance with 
the aggregator and collector event configuration files, discussed above with 
reference to FIG. 2A. 

5 Real-time data is exchanged between the producer event browser 58 and 

the web server 55 such that producers can analyze real time subscriber 
response information and modify interactive content accordingly. Further, 
information related to published events is transmitted back through the system 
to be incorporated into the aggregator event configuration file 52g and the 

10 collector event configuration file 66g. As discussed above ? producers can view 
aggregated response information and modify interactive event broadcasts in 
accordance with response patterns. For example, if subscribers/users 
responding to an interactive polling event are voting in a particular way, the 
producer can supplement the event broadcast with additional information or 

15 commercial advertisements directed to the users' choices. Also, users are able 
to view updated interactive events which incorporate the results of their own 
participation in the event. In the above example, the user could participate in 
the polling event and then see the results of that poll displayed on the access 
device including the user's tally and the votes of other users. 

20 As seen in FIG. 5, common industry technical standards are used for 

communicating between the various components of the interactive media 
response network. Information transmitted between the access device 60 and 
the communications message server 64 preferably is sent in HTTP or HTTPS 
(HTTP with SSL security) format. Internet Protocols (IP) are preferably used for 

25 transmitting response information between the communications message server 
64 and the response collector 66 (preferably Universal Datagram Packets (UDP) 
format), and between the response collector 66 and the response aggregator 52 
(also preferably UDP format) . Information transmitted between the response 
aggregator 52 and the application server 54 preferably is sent in UDP format. 

30 The producer event browser 58 and developer client computers 56 can 

communicate with the web server 55 using HTTP or HTTPS (SSL) format. For 
the purpose of providing event parameters and rules to the response collection 
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and aggregation network, the network and event management workstation 94 
can communicate with the response aggregator, response collector, and 
producer web site in HTTP format. It will be apparent based on the foregoing 
discussion that, e.g., response aggregator 52 refers to one or more response 
5 aggregators, and there may also be one or more of any other components as 
shown in FIGS. 4 and 5. Furthermore, the above communications protocols 
and preferred communications formats are simply representative of preferred 
data transmission formats utilizing the foregoing invention. Any of the following 
formats may be used for transferring information between one or more of the 

10 above components: HTTP, HTTPS (SSL), TCP and UDP over IP, FTP, HTML, 
XML, Enterprise Java, and Internet browser technology. The response 
aggregators, response collectors, communications message servers, and other 
components discussed above operate independently of set-top boxes or other 
access devices and are designed to be server-side platform independent. 

15 FIG. 6 illustrates an interactive media response network 40 for multiple 

heterogeneous subscriber access networks according to a preferred embodiment 
of the present invention. As seen in FIG. 6, multiple heterogeneous subscriber 
networks 42, 44, 46, and 48 are linked to a data center 50 including one or 
more response aggregators 52. The subscriber networks can include an 

20 interactive television subscriber network for cable distribution 42 utilizing the 
ATVEF or DVB-MHP standards, an interactive television subscriber network for 
satellite distribution 44 utilizing the ATVEF or DVB-MHP standards, an 
interactive cellular phone and mobile subscriber network 46 using Wireless 
Application Protocol (WAP), and an interactive personal computer (PC) and/ or 

25 networked appliances subscriber network 48. 

The interactive television subscriber network 42 preferably includes a 
cable distribution network 62 for distributing interactive content to a plurality 
of subscribers, each of the subscribers being linked to the network via a set top 
box 60 situated on or in close proximity to their television set or built into the 

30 set itself. Using a remote control, a keyboard, or other interactive device, the 

user/ subscriber transmits requests in response to interactive content viewed on 
the television screen and thereby participates in the broadcast. The user's 
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response requests are received in the set top box 60 and transmitted through 
the cable distribution network 62 to a communications message server 64. The 
communications message server 64 transmits responses to a response collector 
66 which is preferably housed within the subscriber network 42. After 
5 collection, responses are transmitted to the data center 50 for aggregation. In 
an alternate embodiment, the communications message server 64 can transmit 
responses to a response collector housed within the data center 50 (as shown in 
FIG. 8). 

The communications message server 64 processes HTTP Internet 

10 Protocol (IP) message packet transmission formats including Transmission 
Control Protocol (TCP) and Universal Datagram Packet (UDP). Messages 
exchanged between the communications message server 64, response collector 
66 , and response aggregator 52 can be individual UDP message packets or 
bundles. Responses (i.e. UDP message packets) can be packetized (bundling) 

15 and de-packetized (unbundling) for increased communications efficiencies. 

The communications message server 64 is connected to the cable 
distribution network 62 via high bandwidth communications links (not shown) 
as are known to those skilled in the art. High bandwidth communications links 
also connect response collector 66 with the response aggregator 52. In certain 

20 embodiments, the communications message server may encrypt responses for 
transmission to the response collector, where the responses are decrypted and 
processed for collection purposes. 

The response collector 66 collects and processes normalized responses 
received from the communications message server 64. Responses are collected, 

25 processed, and logged in real time using one or more response collectors 66. 
The response collectors 66 transmit collected responses to one or more of the 
response aggregators 52. Each response aggregator 52 performs a real-time 
data collection, processing, logging and aggregation function. Response 
collectors 66 communicate in a subordinate way with response aggregators 52, 

30 exchanging data via both the push and pull methods. Response collectors 66 
and response aggregators 52 are the same as response collectors 32 and 
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response aggregators 34, respectively, in the response aggregator and collector 
network 12, as shown in FIG. 1. 

Aggregators 52 transmit aggregated results to the application server 54, 
which communicates the results over a secure connection to a web server via 
5 the Internet 55 or other public network or alternative private network, which is 
operably linked to content providers (i.e. developers of interactive content) 
through developer client computers 56 and content producers via producer 
event browsers 58. The aggregated results can be processed by content 
producers 58 and inserted into a video broadcast signal to be transmitted to all 

10 participating subscribers. Using the high volume response collection and 
aggregation functions of the present invention, aggregated results can be 
accessed by content producers and inserted into interactive media broadcasts 
in real time. Participating subscribers can make response requests and have 
their participation be integrated into the event broadcast, thereby affecting the 

15 outcome of the interactive broadcast. 

The heterogeneous interactive media response network of FIG. 6 includes 
one or more satellite television subscriber networks 44, one or more 
mobile /cellular networks 46, and/or one or more interactive PC and appliances 
networks 48, each constructed in a manner similar to the cable distribution 

20 network 42. For example, the satellite television subscriber network 44 

includes a satellite distribution network 72 for broadcasting interactive content 
to subscribers via subscriber set top boxes 70. Response requests are 
transmitted through the network 72 to a communications message server 64. 
Normalized responses from the communications message server 64 are 

25 transmitted to a response collector 66 for collection, and to a response 
aggregator 52 for collection and aggregation. 

Similarly, the mobile subscriber network 46 includes a mobile network 
82 linked to subscribers via access devices 80 embodied in their cellular/ mobile 
telephones or other electronic devices such as the PALM PILOT. Responses are 

30 transmitted through a communications message server 64, a response collector 
66, and to an aggregator 52 in the data center 50. 
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The user of an interactive PC or networked appliance receives interactive 
broadcasts through the interactive PC/networked appliances subscriber 
network 48. Subscribers using interactive personal computers or networked 
appliances linked to the Internet or other public network 92 can receive 
5 broadcasts including interactive content. For example, the user/ subscriber can 
access the Internet or other wide area network 92 through their personal 
computer 90 and log onto a particular web site or location which distributes the 
interactive broadcast content. The user can participate in the broadcast by 
submitting response requests using a mouse, a keyboard, a touch screen, voice 

10 commands, or other interactive access device. The requests are received by a 
network router (not shown) communicating with the Internet, and then 
transmitted to a communications message server 64 and the response collector 
and aggregator network (i.e. a response collector 66 and an aggregator 52). 
It will be apparent to those of ordinary skill in the art that the 

15 communications message server 64, response collector 66, and aggregator 52 
also refer to a plurality of each of these respective components. For a given 
subscriber network 42, 44, 46, or 48, there can be many communications 
message servers 64 and response collectors 66 feeding responses to the data 
center 50, where the responses can be collected and aggregated by one or more 

20 response aggregators 52. The response aggregators 52 have the capability of 
processing and logging responses to populate a data store (not shown) on the 
application server 54 for the purpose of communicating response results to the 
appropriate content providers 56 and content producers 58. In contrast to the 
prior art, however, the present invention is capable of processing a high volume 

25 of responses using a minimal number of components in a single, closed-loop 
system, where each collector and aggregator can process a high volume of 
responses in real time. 

FIG. 7 illustrates an interactive response network for connecting multiple 
interactive television subscriber networks. The interactive response network 

30 preferably includes a plurality of individual iTV subscriber networks, including 
one or more cable television subscriber networks 42 and one or more satellite 
television subscriber networks 44. These networks can include a plurality of 
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sub-networks for distributing interactive content via separate distribution 
channels 62 to separate groups of set top subscriber boxes. Each sub-network 
stream also includes its own communications message servers and response 
collectors. For example, a multiple stream cable subscriber network 142 can 
5 include sub-networks, each of the sub-networks having its own cable 

distribution network 62 for broadcasting interactive content to subscriber set 
top boxes 60 and for forwarding responses to the communications message 
servers 64 and response collectors 66. As shown in FIG. 7, the response 
collectors 66 can then transmit the collected responses to the same aggregator 

10 or group of aggregators 52. 

In another embodiment of the present invention, one or more of the 
primary components (communications message server, response collector, and 
response aggregator) reside in a separate operating environment. As seen in 
FIG. 8, an interactive television response network may include one or more 

15 cable television subscriber networks 42, one or more satellite television 

subscriber networks 44, one or more multiple stream cable networks 142, and 
one or more cable subscriber networks 242 having a distributed component 
arrangement. In FIG. 8, the cable subscriber network 242 includes a cable 
distribution network 62 connected with subscriber set top boxes 60. Responses 

20 are forwarded to a communications message server 64 which is physically 
located at the site of the subscriber network 242. A collector 266 is located 
within the data center 50, instead of within the facilities of the subscriber 
network 242. In the embodiment shown in FIG. 8, the response collector 266 is 
located in close proximity to the response aggregator 52, which may be useful 

25 for security purposes, to control management of the response aggregator and 
collector network, and to add flexibility in communicating with multiple 
communications message servers. In some applications it may be desirable to 
house or co-locate collectors and aggregators together for more effective data 
transfer and logging. In other applications, response collectors and response 

30 aggregators can be housed together at the local network level, such as within 
an interactive television subscriber network. Such an arrangement would 
promote efficient handling of responses on a local level. 
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The above described interactive media response processing system is 
capable of processing responses from a variety of access devices through a 
plurality of different subscriber networks. Responses can be processed 
independent of the particular types of access devices or data transmission 
5 formats, as communications message servers normalize response information 
for transfer to collectors and aggregators. The above system can handle 
interactive responses from a variety of different event applications, including 
but not limited to interactive polling or voting, interactive sweepstakes, 
interactive advertising, interactive "game shows", electronic commerce, betting 

10 and wagering, and requests for additional information. 

Although the invention has been described in detail including the 
preferred embodiments thereof, such description is for illustrative purposes 
only, and it is to be understood that changes and variations including 
improvements may be made by those skilled in the art without departing from 

15 the spirit or scope of the following claims. 
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